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1. INTRODUCTION 

Today, Indonesian transportation problems are increasingly being encountered in our daily life. Sev- 
eral economic and social motivations can be related to the need to minimize the time spent in motorcycle for 
transportation and consequently their related pollution problems. An additional problem worth mentioning is 
the need to reduce traffic accidents, a human and social cost that is related not only inadequate driving, but also 
to the planning of the flow conditions [1]. Due this motivations, the literature on traffic phenomena is already 
vast and characterized by contributions covering modeling aspects, statement of problems, qualitative analysis, 
and particularly developed simulation generated by applications. Continuing this efforts, there are many litera- 
ture of traffic flow theories and models have been developed, but researcher generally agree that modeling has 
not yet reached a satisfying level. Study of traffic flow are become important since many reasons behind that, 
such as: 1) it is necessary to develop traffic model which can describes the real phenomena, 2) traffic model 
can support for developing intelligent transportation system (ITS) whose related with safety driving system, 3) 
traffic model support for future issue about intelligent car [2]. So, there are many researchers who developed 
intelligent transportation system in order to minimize the number of traffic accident [3] [4] [5]. 

Mixed traffic systems are dynamically complex since there are many parameters and variables that 
influence the interactions between the different kinds of motorcycles. These interactions can be described 
as the behavior occurring in traffic. Vehicle behavior is influenced by internal and external factors. Internal 
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factors are the status of the motorcycle such as driver psychology, motorcycle position, steering angle, speed, 
etc. Meanwhile, external factors are environmental conditions such as the position of other vehicles, road 
borders, pedestrians, etc. 

Modeling the behavior of the motorcycle is still being continuously developed, especially in devel- 
oping countries which have the characteristics of mixed traffic. To get a better understanding of motorcycle 
behavior, one can look at maneuvers performed by drivers. Maneuver here can also be called as a movement 
performed by the motorcycle which is a part of motorcycle’s movement to change a lane and also to avoid 
obstacles or slower vehicle in front of him. 

Modeling the maneuver that can adequately simulate actual situations has many benefits, especially to 
solve problems in the field of transportation. Modeling of maneuvers can also describe how a driver interacts 
within a traffic system. In order to reach this goal, various methods have been developed to obtain a model 
that can adequately simulate actual situations. Based on the literature, several methods have been proposed for 
modeling vehicle movement, such as: Rule Based Model [6], Cellular Automata [7] [8] [9], and Social Force 
Model [10] [11] [12]. Each method has its own deficiencies and advantages. Rule Based Model is quite good 
at describing vehicle maneuvers in traffic but it only works well at low traffic density. Problems will occur 
when Rule Based Model is implemented on high-density traffic systems, making the simulation behave in an 
unrealistic manner. Celullar Automata (CA) describes vehicle maneuvers better than the rule-based system but 
has the disadvantage that its position updating rules are deterministic. Lately, Social Force Model (SFM) has 
been applied to describe vehicle maneuvers and it performed better than both Rule Based Model and Celullar 
Automata. SFM can describe the movement of vehicles based on a vector-based approach. In SFM, which 
includes a movement model and the decision-making process of the driver, vehicle behavior is described by 
the sum of several vector forces (acceleration force, repulsive force and attractive force). Although SFM can 
describe vehicle movement better than Rule Based or CA, this method does not input some parameters that 
have a large effect on achieving a realistic model, such as driver psychology or a probabilistic model for driver 
characteristics. 

Markov Chain was broadly use for modeling traffic for different purposes, such as to reduce vehicle 
emission [13], short-term traffic flow forecasting [14], modeling the multi-traffic signal-control synchronization 
[15], traffic state prediction [16], travel time estimation [17], etc. However, no one has modeled the motorcycle 
maneuver using the Markov Chain model. In this research, we tried to build a model of motorcycle movement 
which only focused on maneuver action to avoid the obstacle along with the trajectories using a Markov Chain 
approach. In Markov Chain, the maneuver of motorcycle will described by state transition. The state transition 
model is depend on probability function which will use for determine what action will be executed next. The 
maneuver of motorcycle using Markov Chain model was validated by comparing the analytical result with the 
naturalistic data, with similarity is calculated using MSE. In order to know how good our proposed method can 
describe the maneuver of motorcycle, we try to compare the MSE of the trajectory based on Markov Chain 
model with those using polynomial approach that has been done in previous research [18]. 

This paper is organized as follows. In Section 2, modeling motorcycle maneuvers using a Markov 
chain process is presented. The simulation and analysis of applying this model are discussed in Section 3. 
Finally, in Section 4 this paper is concluded by stating that the Markov chain process can be implemented in 
modeling motorcycle movement trajectories for certain maneuvers. 


2. THE PROPOSED METHOD 

This research tries to build a model of maneuver behavior along with the trajectories using a Markov 
Chain approach. In a Markov Chain process, the driver will make decisions to determine what actions will be 
carried out in a certain environment. Vehicle œ will be in a certain position, moving at a certain speed and 
steering angle at time t, denoted as motorcycle state a (internal information). Next, motorcycle a will receive 
external information from its environment, such as the positions and velocities of vehicles around it, for further 
processing to determine what action is to be taken by motorcycle a. There are several steps must be executed 
to build a motorcycle maneuver model using Markov Chain: 1) Define set of states and actions, 2) Define the 
transition probability function, and 3) State mapping function. 


2.1. Set of States and Actions 


A state is the condition or status of motorcycle agent, which is a function of position (x, y), speed (v) 
and direction of steering maneuvers (0). Meanwhile, action is described by a function of the maneuver m € 
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{0,1,2} with 0, 1, and 2 corresponds to no maneuver, right maneuver, and left maneuver respectively. Similarly, 
acceleration a € {0,1,2} with 0, 1, and 2 corresponds to fixed speed, acceleration, and deceleration. 

In the Markov Chain process, the action of the motorcycle is determined by the probability of a 
transition states. There are ten states to describe the movement of motorcycle, along with nine actions. The set 
of actions (A;) and states (S;) that are used for the motorcycle maneuvers can be seen in Table 1. 


Table 1. Set of States and Actions 


States Definition Actions Definition 

So Vehicle with speed 0 km/h Ai Increases speed with no maneuver 

S Vehicle with speed 3 km/h A2 Increases speed with right maneuver 
S2 Vehicle with speed 6 km/h A3 Increases speed with left maneuver 
S3 Vehicle with speed 9 km/h Ag Decreases speed with no maneuver 
Sir Vehicle at a speed of 3 km/h with left steering angle As Decreases speed with right maneuver 
Sor Vehicle at a speed of 6 km/h with left steering angle A6 Decreases speed with left maneuver 
S3r Vehicle at a speed of 9 km/h with left steering angle Az Decreases speed with right maneuver 
Sir Vehicle at a speed of 3 km/h with left steering angle Ag Fixed velocity with right maneuver 
Sor Vehicle at a speed of 6 km/h with left steering angle Ag Fixed velocity with left maneuver 
S3R Vehicle at a speed of 9 km/h with left steering angle 


2.2. Transition Probabilities 


A maneuver is the movement to change the direction of a vehicle to move from one lane to another. 
Maneuvers in this study are influenced by several parameters, including the internal state of the vehicle as well 
as the external conditions, as shown in Figure 1. 


Figure 1. Illustration of Maneuver’s Parameters 


The parameter in Figure 1 are dag, vg, we, de, , dez,- - - , dbn U61; UB, daB,» daB, DoH, Dov, and 
Wr. Where dag is a distance between motorcycle a and vehicle 2, vg is speed of vehicle 8, wg is the width of 
vehicle 8; (dg,,dg.,..-,dg,,), distance between motorcycle a and vehicles to the left and right, vg, is a speed 
of vehicle to the left, vg, is speed of vehicle to the right, dap, is the distance between vehicle a and the right 
border, dap,, distance between vehicle a and the left border, Do y is a horizontal offset distance to objects that 
are in front of the vehicle, Dov is the vertical offset distance to vehicles to the left or the right of the vehicle, 
and Wp is the width of road. 

There are two steps performed to build the transition probability function. Firstly, to model the prob- 
ability of maneuverability function of the rider. Secondly, to model the probability of maneuvering direction 
(left or right) to be taken by the motorcycle. 


2.2.1. Transition Probability of Vehicle Maneuvers 


The biggest factor that influenced the maneuver is if there is an obstacle in front of the motorcycle. As 
function to model the desire of maneuvering of the driver, negative exponential function can be used to obtain a 
great value for small distances and a small value for large distances. In addition, a critical distance factor (De) 
should be added, which represents the critical distance where the motorcycle must do maneuver. If a maneuver 
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cannot be carried out for example because there are vehicles to the right and left, then the action is decelerate 
the speed. The maneuver intention probability of motorcycle a stated as Pa can be expressed as follows. 
Be e—ki(dap—De) | for dap > De (1) 

“o (el for dag < De 


Where dag is the distance between motorcycle a and the vehicle in front of it (vehicle 8), De is represents the 
critical distance where the motorcycle must do maneuver or decelerate the speed, kı is a constant that shows 
an increased slope rate of a negative exponential curve as a function of the distance between the two vehicles. 
Physically, a small value of kı indicates that the driver wants to maneuver despite the distance to the vehicle in 
front still being quite large (alert driver), while a high value of kı indicates that the driver wants to maneuver 
when the distance to the vehicle in front is already very small (a driver who is reluctant to maneuver unless 
pressed). 


2.2.2. Probability Estimation of Maneuver Direction 


When the decision to maneuver based on Pa exceeds a certain threshold value, the next step is mod- 
eled the optimum maneuver direction. The possible directions for the maneuver are determined by the condition 
of the road, the borders to the right and left, and other vehicles in the vicinity. In this subsection, we build ma- 
neuver direction probability model for six scenarios that commonly occur in traffic, as shown in Figure 2. This 
scenario is still possible to be developed further in a follow-up study, which will be tailored to observations in 
the field and processing the data obtained. The derivation process of the probability model has been done in a 
previous research [18]. 


Table 2. Maneuver Direction Probabilities 


Scenario Probability of Maneuver Direction 
k aw do) y . 
: : Po, =u- e° WR ay 
There are no obstructions on the left nor right z obeda 
Pop =p e Wr eY 
(da.B,—40,) 
Po, =H: eh Wa Ra 
There is an obstruction to the right of the motorcyle 1 — enk4(de1-4810) ford 6, > dgio 
Po, = , 
r G , for de, <dg,o 
ss 1—e7*s(461—-dac) for dg, > dpc 
J= 
There is an obstruction to the left of the motorcycle ñ 0 , for dg, < dg,, 
(daB, 4C,) 
Por =H: Bc wg, ohe 
p 1—e7*s(4a1—4810) for dg, > dgio 
9, = 
. = 0 , for dg, < dgio 
There are obstruction to the right and to the left of the motorcycle Pidasid 
P Pe ela =deic) for dg, > dg,o 
Hage 
s 0 ; for de, < deic 
; : Po, =0 
There is a border on the left or on the right P, =1 
OR ae 
(eB, 40) 
Po, =u eke Wa SE kay 
There are boarders and obstructions 1 — e7 ¥4(dei—deic) for dg, > dgio 
Pip = , 
or lo , for da, < dio 


Table 2 shows the maneuver direction probability function. Pg, denotes the probability of a left 
direction maneuver and Pg, denotes the probability of a right direction maneuver, with k2,k3,k4 and ks 


as constants. Parameter denotes as a function of horizontal offset distances to objects that are in front of 
D OH, Do Hr d 

Dou, +4dou,. Don, +Don, ` Cr 

and dc, denotes critical distance with motorcycle on the left and right. The u value can be set to the value that 


describes the habits of maneuvering direction of Indonesian driver. 


motorcycle a (Dou,,Dou,.), where wg = don, + don,, Vi = and yr = 
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2.3. State-Mapping Function 


After the transition probability function were determined, then we need to build a mapping func- 
tion which describes the state-action mapping of decision making behavior of driver. Mathematically, this is 
expressed by 


P(St41/S¢, Sa, , Ss, SBs 1ta M, a) = P(Si41 Sz, m, a) (2) 


with P(Si+1|Si, Mi, ai) denotes probability function of maneuver and acceleration at time t. 


mE 


t 
= 


Figure 2. Traffic Scenario 


3. RESEARCH METHOD 

The research method consists of three main steps: 1) Data preprocessing, 2) Simulation, and 3) Com- 
paring the simulation results with actual data. Data preprocessing was begin with doing the naturalistic obser- 
vation using video streaming which ensures that the normal behavior can be observed and the data collected 
are not affected by the presence of researchers. Next, in order to obtained pixel coordinate which represents 
motorcycle’s trajectory, coordinates transformation to convert the pixel coordinate to real-world coordinate as 
we seen on Figure 3. The preprocessing of data in this research is similar to those in our previous research [18]. 


Figure 3. The flow of data preprocessing, (a) Targeted motorcycle; (b) Maneuvers trajectory; (c) Photo coordi- 
nate in a pixel 


4. SIMULATION RESULTS AND DISCUSSION 

The simulation results show that motorcycle movement modeling based on a Markov Chain process 
was successfully implemented. The Markov Chain model was evaluated by looking at a plotting diagram. 
There are three diagrams in Figure 4 which describes that Markov Chain was successfully implemented to 
modeled the manuever of motorcycle (a maneuver diagram, a state transition diagram, and an acceleration 
diagram). In Figure 4 (a), the changes of each state and speed for every vehicle during the simulation period 
can be seen clearly. The blue motorcycle change his state in order to get a savely driving. Besides, Figure 4 
(c), we can see the behavior of the blue motorcycle making three times maneuver during simulation time, at the 
5th the 19°”, and the 40t” time step of the duration. In that time, the blue motorcycle sees a vehicle in front of 
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him and try to avoid the vehicle by making a maneuver, while considering the border beside him to calculate 
the maneuver probability. 


The performance of Markov Chain model is verified by comparing actual maneuver trajectory with 
the trajectory from Markov Chain model. Figure 5 (a) shows the actual trajectory data of ten motorcycle’s 
that has taken independently at different time but plotted in one figure. It is interesting to note that there 
are different types of maneuver style in that trajectory, for example motorcycle | makes a complex maneuver 
pattern as to avoid the obstacle. In the other hand, motorcycle 3 and motorcycle 6 take a simple maneuver with 
considerable distance to complete this maneuver. Figure 5 (b) shows the track of Markov Chain model using 


9g Se T T T 
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Figure 4. Markov Chain simulation, (a) State-transition diagram; (b) Acceleration diagram; (c) Maneuver 
decision diagram 


that only accommodate one maneuvering angle which is 45°. We observed in this figure that Markov Chain 
model successfully follow the trend of actual maneuver but cannot produce a smooth pattern. To improve the 
situation, in Figure 5 (c), we add additional states of maneuver steering angle which are 22.5°, 45°, 62.5° to 
accommodate a smoother trajectory pattern which is very close to the actual one. As a comparison we plot the 
curve fitting of the track using static polynomial fitting which are 2"? order polynomial, 3"¢ order polynomial, 
and 4*” order polynomial as shown in Figure 5 (d) (e) (f). In those figures, we observed that polynomial can 
fit the actual trajectory as far as the trajectory is short and simple curve such as the maneuver of motorcycle 
2, 4, and 9. However, polynomial fitting has difficulty to track a complex maneuver such as the maneuver of 
motorcycle 1. This polynomial fitting also cannot track the slight maneuver such as maneuver of motorcycle 7 
and 10. 
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Figure 5. Manually track of ten different motorcycle’s maneuver, (a) actual motorcycle’s maneuver track 
(b) approximation of maneuver’s track using Markov Chain with 0 = 45° (c) approximation of maneuver’s 
track using Markov Chain with 0 = 22.5°, 45°, 62.5° (d) approximation of maneuver’s track using 2”¢ order 
polynomial (e) approximation of maneuver’s track using 3” order polynomial (f) approximation of maneuver’s 
track using 4°” order polynomial 


Performance of each fitting method is shown in Table 3. In Table 3, we observed that Markov Chain 
model give the smallest MSE which 0.7666 about 0.24 better than 4t” order polynomial. Even though in 
most cases the Markov Chain model using 22.5, 45, 62.5 has better MSE but in particular case, for example 
in motorcycle 6, the performance of this model is worse than polynomial fitting, since the maneuver is very 


complex. 


Table 3. Mean Square Error of Motorcycle Maneuver Trajectory Tracking 


Vehicle | 2” order | 3°% order | 4’” order | 6 = 45° | 0 = 22.5°, 45°, 62.5° 
I 2.7076 2.6887 2.1865 1.8073 0.6907 
2 0.0849 0.0640 0.0626 0.4998 0.1472 
3 1.0267 0.8822 0.8655 1.6302 0.4086 
4 0.2525 0.2521 0.2509 0.9108 0.4336 
5 0.8472 0.8092 0.6743 1.1847 0.2783 
6 1.7213 1.3810 1.2796 3.8066 2.3199 
7 1.9405 1.9405 1.9344 2.0455 0.6516 
8 1.4145 1.4056 1.3684 2.0102 0.5179 
9 0.2622 0.2022 0.1966 2.0889 0.7340 
10 2.1705 1.6028 1.2978 3.8687 1.4841 

Average | 1.2428 1.1228 1.0117 1.9853 0.7666 


5. CONCLUSION 


In this research, a simple model based on a Markov Chain process was implemented to describe 
motorcycle maneuver using ten states and nine actions. Besides, the probability function of maneuver intention 
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was introduced in six scenarios which integrated to the state-mapping function of Markov Chain Model. The 
maneuver of motorcycle using Markov Chain model was verified by comparing the analytical result with the 
naturalistic data which give small MSE. This methods also compare with static polynomial fitting to know how 


good 


is Markov Chain can describe a motorcycle maneuver movement. As a result, we found that MSE of 


Markov Chain model is smaller than static polynomial fitting approach. 
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